
DECLARATION UNDER 37 CFR 1.131 



We, Mike Daily, of 60 Inverness Rd, Thousand Oaks, California 91361, Kevin Martin of 
549 Bath Ct, Oak Park, California 91377 and Timothy Hirzel, of 105 Lincoln Road, 
Waylaiid, Massachusetts 01778, do hereby declare that we invented the subject matter of 
Patent Application No. 09/690,574 at least as early as the date of August 5, 1999, and by 
acts undertaken wholly in the United States of America, have diligently pursued this 
invention with the purpose of its reduction to practice. However, the purpose of this 
Declaration is to show that this invention was conceived prior to the priority date of April 
26, 2000, of Patent Application Publication No. 2002/0168986 to Lau et al., and that its 
conception was coupled with diligent effort toward reduction to practice until reduction 
to practice occurred or until the filing date of October 17, 2000. 

The invention that is the subject of this patent application was captured in the Invention 
Disclosure, included herewith as Appendix A and date-stamped on August 5, 1999. As 
noted on sheet 1 of the Invention Disclosure, we declare that we completed the first 
embodiment of the invention on May 26, 1999, with the initial conception of the 
invention captured in the form of computer notes on May 26, 1999. The invention 
disclosure provides support for the subject matter in all of the claims of Patent 
Application No. 09/690,574. 

We hereby declare that all statements made herein of my own knowledge are true and 
that all statements made on information and belief are believed to be true; and further that 
these statements were made with the knowledge that willful false statements and the like 
so made are punishable by fine or imprisonment, or both, under 18 U.S.C. 1001 and that 
such willful false statements may jeopardize the validity of the application or any patent 
issued thereon. 
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This is to acknowledge that the above invention Disclosure has been received by HRL 
Laboratories, LLC Patents and Licensing. The disclosure will be reviewed at the next 
Evaluation Committee Meeting of your organization and you will be promptly informed of 
the results. If you have any questions please contact the patent attorney listed on the 
bottom of this form. 


This sheet will be returned to the inventor(s) as a confirmation of receipt 
by HRL Laboratories, LLC Patents and Licensing. 


LOSS OF RIGHTS THROUGH RELEASE TO THE PUBLIC 


The right to apply for and obtain a valid patent may be lost as the result of certain 
activities, such as (1) disclosing the invention outside of the company without an 
appropriate confidentiality agreement with the receiving party; (2) using the invention 
publicly; (3) using the invention privately to build or test items that are to be sold 
publicly; or (4) putting the invention "on sale" by selling or offering for sale an item or 
product that embodies or uses the invention, or is made or tested by use of the invention. 
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8. SUMMARY OF THE INVENTION 


A. GIVE A BRIEF DESCRIPTION OF YOUR INVENTION, PARTICULARLY POINTING OUT WHAT IS BEUEVED 
TO BE NOVEL (THE "HEART" OF WHAT IS NEW). 

This invention describes the system needed to enable mobile users to place and access audio and other information at locations in the environment. The 
novel aspect of the system is the unique convergence of technologies that provide a real time publicly (or controlled, privately) accessible "whiteboard* of 
audio and other information types delivered as audio. Both mobile and fixed users can add location specific information to a distributed web-based server 
that is then accessible by users based on a variety of location based queries. The system requires no additional infrastructure such as special devices or 
networks and enables real time location specific annotations and information. Figure 1 shows the overall system concept. 



Figure 1 : Real lime location embedded audio with no added Infrastructure supporting stationary and mobile 

B. EXPUIN THE PURPOSE AND ADVANTAGES OF YOUR INVENTION. (WHAT WILL THE INVENTION DO BETTER 
THAN DONE PREVIOUSLY?) 


users. 
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AudioOnLocatJon enables users to hear audio that is virtually embedded in places with context as they move through the environment, ft allows the user to 
annotate places with audio in real time, from either fixed or mobile systems, that is then stored in a server and can be accessed remotely from fixed systems 
or as the user moves to new locations or points in the direction of previously annotated objects or places. 

Previous systems suffer from a variety of deficiencies that require external infrastructure to enable user tracking, use very coarse position information {such 
as cellular systems), can not use orientation information, do not enable real time access to new information, and do not enable users to add new 
information. Our system enables any user to access embedded audio attached there by any other user. It also provides a real time method for placing new 
annotations on places in the environment which previous systems do not allow. 


C. IDENTIFY THE COMPANY PROGRAM OR PRODUCT UNE TO WHICH THE INVENTION APPLIES, AND THE EXPECTED VALUE 
TO THE PROGRAM OR PROOUCT LINE. ALSO IDENTIFY POTENTIAL COMMERCIAL APPLICATION OF THIS INVENTION, 
INCLUDING AUTOMOTIVE APPLICATIONS, IF ANY. 

This system will have direct applicability to soldier technologies including Land Warrior, SUOSAS, Special Forces, and mobile command and control by 
enabling rapid smart environment audio infrastructure for communication and situation awareness. 

In addition, the capability can be applied within automobiles or other moving vehicles to enable smart highway communication with driver. Advanced cell 
phones with location awareness will also take advantage of this system functionality, as will rapid infrastructure to support education, museums, etc. A targe 
number of location specific information services are possible with such a system. 


D. IDENTIFY THE PRIOR ART KNOWN TO YOU WHICH IS IMPROVED UPON OR DISPLACED BY YOUR INVENTION. AND STATE 
IN DETAIL, IF KNOWN, THE DISADVANTAGES OF THE CLOSEST PRIOR ART. 

Museums employ an active system with either user initiated audio from tape recorders at known locations or active infrared communication between fixed 
infrastructure and modified tape recorder playback devices. These clo not enable widespread use, user annotation, device or user tracking, real time 
updates, or a variety of advanced functions possible with more capable playback using mobile, wearable computing. They also require fixed, static 
hardware and software infrastructure with certain higher maintenance costs. 

AirFIash.com will offer a service for mobile phone users later this year that provides business, entertainment, and travel information specific to a user's 
location. This system is based on a cell phone user's known position location determined by which antenna is used to access the network, allowing search 
results to be tailored to a user's location. It does not provide accurate position information or orientation sensitivity. Some ability to access any geographic 
information is provided through a database service, which could also be used by this invention. 


9. DETAILED DESCRIPTION 

DESCRIBE YOUR INVENTION IN DETAIL* USING NECESSARY ADDITIONAL SHEETS 

A. BE SURE THAT EACH SHEET IS DATED, AND SIGNED BY EACH INVENTOR AND TWO WITNESSES. 
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8. ATTACH COPIES OF DRAWINGS OR DETAILED REPORTS HELPFUL IN UNDERSTANDING HOW YOUR INVENTION WORKS 


C. IF YOUR INVENTION HAS BEEN TESTED. BRIEFLY SUMMARIZE THE TEST RESULTS WHICH CONFIRM THE 
FUNCTIONS AND ADVANTAGES LISTED IN 8 0 ABOVE. 

^i di 29 nLocation is a svstam ^ enables mobile users to obtain audio information that is context and location dependent. It also provides the necessary 
infrastructure to enable any user at any location to embed audio in specific locations that can then be accessed by other users either from that location 
JJfil^Sf! 0 ,n | ormati 2 n ac f 6S f appliances, or from any remote location using a variety of interfaces through the World Wide Web, Figure 2 below shows 
the sequence of operations {and optional operations) that occur when the system is used to retrieve audio either via explicit or implicit (push) request 
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Verbal Request(opt) Speech-to-Tcxt (opt)->Pasition Tag Compress (opt) -> Transmit (opt) 

i 


Client 


Play -4— Spatialize (opt) 


-Text-to-Speech (opt) 4— Decompress (opt) 
Figure 2: Operations pertormed in audio retnevai. 



Client or Server 


remote locations and be connected via wireless or cellular networks to the client: 

The system may be used in an information push mode where user location is constantly streamed to ^^ r 4^<^^ the sefver 
automatically identifies and sends the audio to the client based on predeterm.ned parameters such as distance from current position. 

A more advanced use of AudioOnLocation enables explicit querying of the Information Server based on position and orientation of heW ° r 

£S?3^K an object orregion of interest from a remote position. Tne system determines what objects are 

potentially of interest using the user's current position and the pointing vector and retneves and plays them. 
The AudioOnLocation Information Server is composed of the following software functions (shown graphically in Figure 3): 

1 ) User interface: This function provides the user with the ability to selectively contrtf the scope and generation of 9^S^S^!^!S£S^ SUfa 
pad or other input device. It also allows the user to provide relevant information .n the form of preferences to aid in selecting and controlling the audio 
playback messages. The user may explicitly provide a position. 

2) Position Sensors: A variety of complementary sensors provide the user's position and, optionally, orientation (a six dimensional vector) to the position 
manager. 

3) Content Manager: This function receives content from the User Interface and sends links to content to the Database Update Manager. It sends the 
content {file) to the content pool. These functions are separated to enable distributed management and storage of the content. 

4) Position Manager: This function takes any user supplied position data or alternatively, position data from sensors and sends it to the database update 
manager to be linked with the current recorded content, and to the database query manager. 
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Database Update Manager: This function matches the content reference and the position data and updates the database. 


BE^TOffiyw » rivate> Susiness (e - 9 ' restaurant - c ° mmerce) ' «* 9 enerai - 

7, P^ybacK Manager. This function uses a. content tiSSSXn* 

tnmSZS^^ Playback features, network or cellular connectivity constraints, etc. 

9) Content Pool: The audio, text, or other information is stored as files referenced by URL and may be local or remote (completely distributed) from the 

other system components. 



Figure 3: Information Server Block Diagram 


in one preferred embodiment of the invention, a user with a mobile phone and GPS (such as the Garmin NavTalk product) dials th je ^^^^ . . 
AudioOnlLocation Information Server. Figure 4 shows the user's interaction with the Information Server through an automatic call answering service for me 
simplest case in which there is only one item of information within the desired range of the user's position. 

Figure 5 shows a slightly more complex case in which the user hears a menu of items that allow selection of specific information types or system functions. 
In this case, the user selects to hear all the current audio and might hear something like There are 5 information items within 20 meters of your current 
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oosition You may choose to listen to any one of them by entering the number of the hem Mowed by the # sign." The user enters a number for the item 

IXCe U and played through the cell phone br» as analog aud.o. 
Rgure 6 shows a case where a user chooses from a menu of items that allows the user to speaK an audio annotation at the user's current position that ,s 
placed in the AudioOnLocation Information Server. 



User Dials Number 


|$vstem Requests Position 

Cell Phone Responds 
W/positlon 


User Provides Position 
, Audio 



User Position (laLjong) 


Audio _ 



Figure 4: A simple cell phone based use of AudioOnLocation.. 



User Dials Number 


^System Requests Position 1 
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Cell Pbone Responds 


W/position 


User Provides Position 


^ ^ Menu of Choices 




User Selects from Menu 


Audio 





Number of Items 

-> 


Specific Audio Request 



Audio 
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Figure 5: A menu-based interaction between user with cell phone and AudioOnLocation system. 
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Figure 6: A user adds audio annotation in the information server at the current position. 
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